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Kenn«'>.h  J.  Arrow  and  Leonid  Hurwiet^ 


I.  Introduction 

I.l.  T7<e  uaual  applications  of  the  method  of  La^an^an  multipliers,  used  in 
locating  constrained  extrema  (say  maxima),  involve  the  setting  up  of  the 
Uarangian  expression 

(1)  •  f(x)  ♦  y*g(*) 

where  f(x}  is  being  (say)  aaxiaiced  with  respect  to  the  (vector)  variable  x, 
subject  to  the  constraint  (vector)  g(x)  ■  0  and  j  is  the  Lagrange  multiplier 
(vector).^ 

The  essential  step  of  the  customary  procedure  is  the  solution  for  x,  as 
well  as  y,  of  the  pair  of  (vector)  eruations,^ 

(?.l)  0 

(?.?)  g(x)  -  0. 

let  (*,y)  be  the  solution  of  eruations  (?),  while  'x  maxirlses  f(x)  subject 
to  g(x)  •  0.  Then,  under  s’oitable  restrictions, 

C')  X  •  X. 


1.  The  authors  wish  to  tr^nk  The  RAND  Corporation,  under  whose  auspices 
most  of  this  work  was  done,  and  the  Office  of  Naval  Research  for  additional 
support  and  assistance. 

P.  X  •  ...  .xnjj-,  y  ■  ^71»**»»y)(  J’  •  '1^  J'  indicates  a  columi 

vector.  The  prime  indicates  trar.sposltion;  thus  y*  is  a  row  vector.  g(*) 
sttps  the  points  of  the  N-iimensional  x-space  into  an  M-dimensional  apace; 
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I.?.  In  j  Kuhn  and  Tuckar  treat  the  related  probleir.  of  oiaximleing  f(x) 
subject  to  the  constraints^’^  k(x)  «  0,  x  «  0.  This  problem  includes,  by  a 
suitable  refonnulation,  the  case  of  maxinizing  X  subject  to  both  eoualitles 
and  ineoualities,  since  (g^,  being  real -valued)  the  equality  g.nCx)  „  0  is 
enulvalent  to  the  pair  of  inenuallties  gp(x)  «  0,  “  0.  The  case  where 

a  coaponsnt  of  x  is  'onrestricte.!  as  to  sign  can  also  be  Handled  within 

this  framework  through  a  replacar.ert  of  x^  by  the  difference  Xjj^-Xj^p  where 
the  two  new  variables  are  renuired  to  be  non-negative.  (In  later 

sections  of  this  paper  we  shall  treat  directly  the  class  of  situations  where 


f(x)  is  to  be  maxlmited  subject  to  g^^^(x)  *  0,  ■■  0,  0,  x* 

not  restricted  as  to 


,LJ>  o  i-'l 


sign,  X  •  {.W,  .[■']}.) 


Denote  by  Cg  the  set  of  all  x  satisfying  the  constraints  g(x)  »  0,  x  b  0. 

The  following  two  results  are  of  fundamer.tal  i3jp>ortance  in  what  follows. 

A.  Theorem  1.)  Let  £  satisfy  the  following  condition  (called  Con- 

6  ~ 

straint  C^ialiflcation,  here  abbre'/iated  '.s  C.I.):  If  x  is  a  boundary  point 

of  Cg,  and  ^  satisfies  the  relations 


(4.0) 


(4.0*)  ?0(x-x)  ^  0. 

(4.0**)  x^-x^  i  0, 


4.  For  an  arbitrary  K -dimensional  vector  a  —  <ai^,ay,...  ,ayr  the  relation 

>  >  '■ 

a  “  0  is  here  defined  to  mean  aj^  «-•  0  for  k  •  1,2,...,K.  (Another  definition 

of  such  vectorial  inerualitles,  permitting  f-eater  generality  of  treatment, 

will  be  uee^  below.)  a  >  0  mearis  ay  >  0  for  k  —  1, ?,..., K. 

K  In  [l]  our  f  and  g  are  respectively  written  as  £  and  F.  The  symbol 
in  [l]  for  the  La^ange  multiplier  (our  £)  Is  u. 

6.  [l,  p.  4^31.  This  restriction  "is  designeii  to  rule  out  singularities 

on  the  botindary  of  the  constraint  set,  such  as  an  outwar'i-polnting  ’cusp*." 
It  should  be  notefi,  however,  that  (because  of  (4.0*))  C.C.  is  a  property  of 
£,  not  merely  of  Cg.  Thue  g(x)  <■  -  (x-1)^,  x  one-dimenelonal,  lacks  C.i., 

while  g(x)  •  -  (x-1),  with  the  same  Cg,  does  nave  it. 
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%«h«r«  avmr  a  ayabol  danotM  Its  av^uatlon  at  x  « 

g'P>  0,  X  •  X*  >  0,  x^  •  0,  than  thars  axlsts  a  dlffarantlabla  ractor- 

valuad  function  T  of  tha  real  varlabls  0  vdiosa  domain  Is  tha  olosad  Intarral 
[o,l3  and  tna  range  Is  In  l.a.,  x  4^(d},  such  that  Y  (0)  *  ^  Y*(0)  * 

X(x-x)  for  soma  positive  scalar  X* 

Under  this  condition,  if  all  derivatives  used  below  axist  and  if  x  naxl- 
adtes  f(x)  for  there  eocists  y  satisfying  tha  conditions 

(4.1)  0.  0,  -  0. 


(4.?) 


y  ^  0,  0, 


-  0, 


where 


[  9xi  ®XN  J  L  ^ 


are  partial 


(vector)  derivatives  of  the  Lagran/rlan  expression  (1)  evaluated  at  (x,/). 

9.  ([l].  Theorem  3.)  If  tha  hypotheses  specified  in  (A)  hold  and,  In  addl- 

tlon,  the  functiotis  f(x),  ^^^(x),  m  »  1,...,M  are  concave, '  there  exists  a 
pair  (x,y),  satisfying  conditions  (4),  such  that  (x,y)  Is  a  non-negative 
saddle- point  (?INSP)  of  0(x,y),  i.e,. 


(5)  0(x,y)  -  0(x,y)  -  (^(x,y)  for  all  x  -  0,  y^  0; 

furthejeicre,  any  NKSP  (Sr,jr)  of  0{x,j)  ^iss  the  property  that  IT  aaxlmltas 
f(x)  in 


7.  A  function  f(x)  Is  said  to  be  concave  if 

(l-«)f(x'’)  ♦  0f(x)-  f[(l-0)x®  ♦  ©x] 

for  all  Om  ©^1  and  all  x°  and  x  In  the  region  where  f(x)  Is  defined.  See 

[1.  pp.  10-Uj. 

f*.  According  to  Leiima  1.  [ij,  conditions  (4)  are  Implied  by  (5)  regard¬ 
less  of  the  nature  of  0(x,y),  i.e.,  even  if  (l(x,y)  is  not  given  by  (1). 
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1.3.  Gcuna  interpretation.  The  result  containe<l  in  (B)  above  can  be  Inter- 
pretecl  in  the  language  of  the  theory  of  games.  It  states  that  it  Is  possible 
to  set  up  a  two-person  cero-sur.  game  where  the  maxindsing  player  controls 
X  ^  0  while  the  miniraiaing  player  controls  y  ^  0  and  the  payoff  to  the  maxi- 
aiaing  player  is  given  by  0(x,y)  •  f(x)  ♦  y*g(x).  Mixed  strategies  are 
regarded  as  excluded.  (B)  Lmplies  that  the  solution  x  of  the  constrained 
aaximlaation  problem  can  be  obtained  as  an  optimal  strategy  x  of  the  maxi- 
siting  player  in  g^;  furthermore,  any  optimal  strategy  x  of  the  maxi  miring 

—  A 

player  in  g^  has  the  property  x  •  x.  It  will  be  noted  that  the  corresponding 
optimal  strategy  y  of  the  minircitlng  player  jdelds  the  Lagrangian  multiplier 
for  the  constrained  maximitation  problem. 

1.4.  Aj^tenyt;  ve  game  interpretation.  Let  be  a  given  (vector)  constant 
and  define  h(x)  by 

(7)  h(x)  -  f  -  g(x). 

Then  the  LsKrangian  expressior.  (1)  becomes 

(0)  0(x.y)  -  f(x)  ♦  y»[r-  h(x)]. 

It  is  now  possible  to  set  up  a  two-person  game  (which  is  not  neces¬ 
sarily  sero-suir)  where  the  payoff  function  of  the  x-player  is 

(9)  ^(x,y)  •  f(x)  -  y»h(x) 

9.  A  pair  of  stratagies  (x.y)  is  said  to  be  optimal  in  a  tero-sum  two- 
person  game  if  x  €  X,  y  «.  T  where  X,T,  are  the  respective  strategy  domains 
of  the  two  players  and  the  relation 

P(x,y)  •  P(x,y)  ■  P(x,y)  for  all  x  e  X,  y  a  T 

holds,  where  P(x,y)  is  the  payoff  function  of  the  maximising  x-player. 
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whlle  the  payoff  function  of  the  y-pl*yer  Is 

(10)  -0^  (x.y)  -  -  y»[j'-  h(x)]. 

• 

With  reference  to  g^,  the  result  of  (B)  above  ioplies  that  the  solution 
'x  of  the  constrained  Tnaxlmi  cation  problem  can  be  obtained  as  an  optiiaal 
strategy^^  x  of  the  x-player  in  g^. 

As  before,  any  optimal  x  strategy  of  the  x-player  has  the  property 
X  *  'x.  Also,  the  optimal  strategy  of  the  y-player,  y,  gives  the  Lagrange 
multiplier  of  the  Lagrange  problem. 

1.5.  Econondc  interpretation.  Th.e  econoaic  interpretation  of  (B),  as 
suggested  by  the  authors  of  [l] ,  can  best  be  stated  in  relation  to  the  game 
g^.  Let  X  (by  d  efinition  non-negative)  be  the  activity  level  vector  (cf. 
Xoopnans,  [?])•  Interpret  f ts  the  available  (vector)  amount  of  primary 
comodities  wh.lle  t  •=  h(x)  is  the  (vector)  amount  actually  used.  Denote  by 

. J  the  desired  coiaaodity  output  (vector).  We  have  v  «»  k(x)  ■■ 

'^J<j^(x) . kp(x)^.  Finally,  assume  (for  the  sake  of  simplicity)  that  the 

utility  function  is  linear  in  the  components  of  v,  say  u(v)  •  ^  ®p'^p  * 


10.  Using  the  concept  proposefi  by  Nash,  optimality  in  an  N-person  game 
is  define-'  as  follows.  Write  x^  for  the  strategy  of  the  n-th.  player, 

x^t  >L^  (l.e.,  x«i);  let  x  —  ..  .  and 

t,he  payoff  function  of  the  n-th 

player  by  Pn^*n»*)n(^*  1*  said  to  be  an  enuillbrd.um  point  of  the 

game  and  the  components  of  X  optimal  if 

Pn(^*^.)n()  •  Pn(^.^)n()  r.  -  1,...,N. 


It  vill  be  noted  that  the  saddle-point  definition  of  optimality  for  a  two- 
person  cero-sua  game  (see  preceding  footnote)  is  a  special  case  of  the 
present  (Nash)  definition. 
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wlth  a  Qpj-.  Define  f(x)  •  u(v)  where  ▼  te  •  fvmction  of  x, 

^  e  9  #  f 


(11) 


f(x)  -  I  Opk  (x)  -  Q»k{x), 

P-1  ^ 


Then  the  problea  of  MLxlaizinf  utilitj  with  regard  to  the  actlrltj  lerel, 
■ubjeot  to  arallablUty  of  the  required  prlaarj  comodltlea,  requires  t.he 
■axlsitstlon  of  f (x)  subject  to  x  >  0,  f(x)  >  0  where  g(x)  Is  obtained 
fro«  r  and  h(x)  according  to  (7). 

The  "allocation  gsae"  g^  (cf.  Koopnans,  [2]  Is  played  by  three 
persons:  the  helasaan,  the  aansger,  and  the  custodian.  The  helasasn 
sets  (once  and  for  all)  the  desired  cossKxlity  price  rector  o;  he  also 
sells  to  the  custodian  the  arallable  aaount  f  of  the  primary  conodltles. 

The  custodian  seta  the  price  rector  of  the  primary  cosModltlea  j[* 
purchases  j*  from  the  helmsman  at  this  price  and  sells  an  tumount  ^  to  the 
manager  the  same  price.  The  manager  purchases  z  from  the  custodian, 
determines  the  lerel  of  activity  x  which  will  Just  use  up  z,  produces 
the  amount  r  of  desired  coossodltles  and  sells  this  to  the  helmsman  at  the 
present  price  a. 

Irfhlle  three  persons  appear  In  the  description  of  g*  .  the  role  of 

PA 

the  helmsman  Is  purely  auxiliary  (eqviiralent  to  formulating  certain  rules 
of  the  game).  Hence  we  shall  regard  this  game  as  a  two-person  game,  the 
two  players  being  the  manager  (controlling  x)  and  the  custodian  (controlling 
j).  Hie  pmyoff  functions  for  each  are  given  by  the  net  profit  on  the 
transactions  undertaken.  The  revenue  and  cost  of  the  two  players  may  be 
presented  In  a  tabular  form: 


Kanager 


revenue  cost 


f(x)  -  a  *k(x) 

— 

y»h(x) 

y»h(x) 

r'f 

Custodian 
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Cle^rly  Is  a  sp^olAl  cAse  of  gj  for  tha  f(x)  apaclflad  bj  (II).  Ranoa 
a  solution  of  g^^  vill  hara  tha  propartlas  daacrlbad  in  1.4  iajxliad  bj  (B). 
In  particularf  tha  actirltj  laval  Baxiaitlng  tha  aanagar's  profits  will 
also  aaxisiita  tha  utilitj  function  subjaet  to  tha  arailabilitj  of  prlaary 
conoditias. 

1.6.  Dacsntraliaatjon.  A  caia  of  particular  intarast  arieas  whan 
additiritj  holds,  ris. 

kp(x)  -  k;(x„) 


(12) 


n*l 


N 


P  *  • »P 


n. 


lv(x)  -  1  h,(x^) 

n*l 


1,2,...,)( 


("Linear  prograaning"  is  a  special  case  of  (12)  with 


where  and  ”  are  constants.) 

P  ■ 


P  •  . . . ,P 

B  *  1,2,...  ,M 

*0 


Whan  (12)  holds  a  dacantralitad  allocation  aaaa  g^^  aajr  be  obtained 
froB  as  follows.  Each  component  of  ^  i*  now  controlled  by  a  separate 
custodian  who  deals  in  only  one  primary  conaodity  and  whose  payoff  function 
is  giran  by 


(U) 


n\(x.r)  .  -  J_(f_  -  I  hj;(x^))  .  -  1,2,...^. 

n*i 


Similarly  each  oomponent  of  x  is  controlled  by  a  separata  manager  who 
is  in  charge  of  one  plant  only  and  whose  payoff  function  is  giran  by 

P  M 

(15)  •  t  o  k"(x^)  -  I  y,h2(«„)  n  .  1,2,...,H. 

P-1  ^  ^  m-l 
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A?  before,  ase  payoff  furclioriS  rAy  be  interpreter!  as  net  profits  on 
the  transactions  uiidertaken  by  the  custof’ Ians  and  managers. 

It  is  a.irain  true  that  the  optiral  (for  definition,  see  footnote  In 

I. /*  above)  strate^ries  (x,y)  of  the  (N  ♦  M)  -  oerson  non-2cro-r<um  j^ar.s 
are  such  that  x  ■  x  and  y  is  the  Lagrangian  .’sultipli  er, 

II.  A  Mo-*irie-i  Lagrangian  Approach, 

11. 1.  Because  of  tne  Interesting  ga.7.0  theoretical  nnd  economic  lT.pllcf>- 
tlons  of  the  Theorem,  in  (B),  1.7  above  (some  of  which  the  authors  will 
study  elsewhere),  the  ouestion  arises  as  to  t^'S  possibility  o'’  sinilar 
results  •..'hen  sotne  of  the  condi.ions  of  the  t'^eorem  are  relaxed. 

It  turns  out  that  residts  of  sue!'  nature  can  be  ohtalnei,  tt.ougt  not 
vit'^out  so"e  s'-.cri fi 00’='.  The  relfuation  1"  prlraarlly  »dth  regap^  t-  t!.<=“ 
convexity  as3u:;;t1ona  •hic^'.  fail  to  iold  i.n  “One  important  economic  /tppli- 
cations  (the  case  of  '’Increa jing  returns")*  Tr^  nalr  “acr.  fie*s  are 
these;  the  Lagrangian  exjiression  is  cKxiif'eJ  an!  t'-e  results  are  proved 
only  locally. 

The  res’ults  ar«  rresentef;  balow  in  the  for;;:  of  tl.rse  theore".s,  .'loir.e 
re-Tiarks  concerning  the  interpretation  r'lf  results  are  contained  in  III  below. 

Theore-',  1  is  auxiliary  !n  nature;  Theorems  '  ari !  !  together  Imply 
the  existence  of  a  local  aon-nsgative  sadlle-polnt  for  the  ir.odifletl 
lAgrangi  i^n  expression.  Tlieorcm  ^  shows  t.n^s  saddle-p^ilnt  to  he  cf  t:  e 
type  leading  to  convergence  :n  grsiie;.*  procedures  lescrlbe';  !.y  tie 
authors  in  [']. 

Th.e  notation  liffere  in  some  'ctail  frem  th.at  introrluce-.  :n  I 
above.  To  facilitate  reading  soj.e  nctat'.onal  princi'les,  'rli.cipies 
are  8tate<l  in  II. .''.i  an'  t!.e  -nain  symbols  jsc  ’  are  lisle,  In  7..'  a:  I  .'. 
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II. 2.1.  3o—  Prlncipleg  of  lloUtion.  k  i-<ll*«n«lonAl  coluan  ractor 

{*1(*2**  *  *  d«not«d  bj  4{  dim  4  danotas  the  ntaiber  of  coaponente  in  £• 

If  A  ie  4  Mtrlx,  A*  ie  ite  trmnspoM.  Hence,  in  partieulAr,  4*  ie  4  row 

K 

vector  end  4*b  ■  \\  inner  product  of  the  vectors  end  b;  e.b 

Is  en  eltemetive,  end  sometiaet  acre  convenient,  notation  for  4*b. 

[*^1*^2'***'^]  finite  (unordsred)  set  whose  elsaents  ere 

4i,42,*  *  *  ,4j^*  A^B  is  the  set  of  ell  elesunts  in  A  but  not  in  B  (the 
set-theoretic  difference). 

X I I  denotes  the  set  of  ell  x  possessing  the  property  P^.  If 

C(4)  -  10^(4), C2(4),...,C^(4)j, 


then 


*  ■  {^**2****»*k}' 

c,  •  Cj(»)  -livn,  p.l,2,...,P: 


c,  c  denote,  respectively,  0(4)  end  c  (e)  *  c  evaluated  at  a  ■  a. 

ft  w 

IfV^(4,b)  is  a  real-valued  (scalar)  function  of  the  vectors 

•  -  {•i**2»***»h}  ^  » 


then 


- 1  1 1  '  k-i.*.— '••1.2 . s- 


denotes  evaluated  at  (a,  b). 

3^  (x°)  •  '[x|d(x,x°)  ^  where  d(x*,x")  denotes  the  Kuclidsan  distance 


between  x*  end  x" 
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11*2.2.  3om»  3ybol«  Ufd. 
(M.l.l)  X  - 


Z  If  thf  luclidfan  l-tpac*  of  th#  x's. 


/r 


-  1,2,... ,« 


/f  if  4  fixed  (poffibly  faptyi  not  neceff4rilj  proper)  subset 
of/V.  (Za  will  be  seen  in  (11.1.4)  below,  the  elssieots  of 
yf*  ere  the  indices  of  the  coaponents  of  x^es  defined 
in  the  first  perscreph  of  1.2.) 

(B.1.2)  t  -  {*i.22******k}* 

Z  is  the  Buclideen  M-speoe  of  the  £'s. 

[l,2,...Jl]. 

^  1.  4  fixed  (possiblj  eaptj,  not  neceeserllj  proper)  subset 

of  (Ae  will  be  seen  from  (H.1.4),  (li.2),  (N.3)  below, 

the  elenents  of  v  ere  the  indices  of  the  conponents  of 

es  defined  in  the  first  peregreph  of  1.2;  the  eleaents 
of  ere  the  indices  of  (cf.  ibid. ) ;  g  will  be 

(lrfln.d  .. 

(i.1.3)  7  -{ji.jj . 7,}. 

T  is  the  Buclideen  N-spece  of  the  j[*s. 

(  T  is  the  spece  of  the  reel-relued  lineer  functions  on  Z. 

Bren  in  the  Buclideen  cese  it  is  conrenient  to  distingriish 
betwesn  the  two,  since  our  definitions  of  non-negetiritj  in 
the  two  speces  differ.) 


(1.1.4)  X  ■  0  eeens 


-  0  f  jr 


X  unrestricted  es  to  sign  for 


is  the  set  of  ell 


X  ^  0. 


n  ^ 
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0  means 

i 

s 

•V 

o 

for 

■  t 

■ 

-  0 

for 

af/t’ 

7  ■ 

0  means 

1  ^m 

-  0 

for 

■  t 

’  ^m 

unrestricted 

1  as  to 

'\ 

For  4xiy  roctor  a  -  ^  4^,42* ...  ,ay|  , 


a  •  0 

means 

•l 

■ 

o 

^r 

•  0,  .  .  .  ,4^^ 

-  0; 

a  >  0 

Deans 

*1 

>  0,  42 

'>  o,...,ag 

>  0; 

a  <  0 

means 

-a 

>  0  .1 

(lf.2.1)  *g  is  4  function  on  to  Z.  Hone* 

*g(x)  •  ]*gi(x),  *«2^*^»***»**H^*^)  **■* 

rMl-T4lu*d  finctiont. 

(Ii.2.2)  W«  shall  find  it  cooTsnisnt  to  work  with  soa*  of  the  ■  «. 

rsplacod  bj  thsir  nsgatirss. 

More  precisel/,  ws  wrlt« 


**■ 

if 

B  t  /L 

*11 

j 

1 

-*«n 

if 

..  A* 

where 

'1'  ■_  . 

is  defined  in 

II. 

,3.4c  below. 

r 

e 

Note. 

Since 

- 

it  is 

seen  that  the 

*g 

(x)  -  0,  g(x) 

> 

0 

are  equivalent.  For  practical  purposes,  one  could  consider  the 
problen  as  given  direotlj  in  terau  of  £,  rather  than  *g.  We 
start  with  *g,  however,  in  order  to  avoid  the  impression  of  a 
loss  of  generality  in  connection  with  the  assumptions  of  II.3.4.C. 
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(M.3)  Cg  -  ^  x|**(i)  ^  0,  X  -  o]  »  ■  ij*(x)  -  0,  x-o} 

(th®  "con^tp^int  iet"). 

(N.4)  f  1®  a  r®4l-v&Iu®d  function  on  (th®'%ariman(l*). 

(U.S)  0^  -*  x*|x’<t  C  and  f(x)  •  f{x*)  for  all  xtC 

(th®  "optiauil  t®t**). 

(N.6)  X  -  Ax'^^,  x^^^  [  wh®r® 

I  -  the  let  of  lndic®8  of  th®  co«pon®nt8  of  1  •  1,2 

if  or  n  * and  x  >0 

'  n 

(2)  * 

r.t  <  if  n'  ■<'  and  x^  •  0 

for  a  given  xt  0^^  and  ®ither  coaiponant  nay  be  amply. 

Mote  1.  Wh«n  a  vector  a  ia  partitioned  into  two  subvectors,  aay 

a  •  <  a*, a** 

t  _v 

and  we  say  that  a*  (or:  a**)  la  ampty,  this  aeana  that 
a  •  a**  (or;  a  •  a*). 

Mote  2.  The  above  partitioning  of  the  vector  x  obvlouely  dependa 

on  the  point  x  In  0.  cboaen.  The  same  is  true  of  the 

ff 

partitioning  in  (M.7)  below  and  of  various  subsequent 
partitionings  of  x  and  £.  It  is  understood  that  all 
these  partitionings  refer  to  the  same  choice  of  x,  and 
that  X,  once  chosen,  remains  fixed. 

(M.'’)  g  -  \  I 

where 

g'  "'(x)  -  0,  g  >  0 

and  either  coaponarit  may  be  empty. 

(M.8)  h(x)  -  l-g(x) 

where  1  denotes  the  M-dimensional  vector  with  l*a  as  components; 

h-  "  ^  -  i-g  ^  ,  1  -  1,2. 
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(N-9)  y  Pj^(x)  - 

I  ■ 

(M>10)  ^  1  *  ^  ^  2  *  *  *  *  *  ^' m"} * 

(N.ll)  y;p(x)  -  ^  r|  ,^p^(x},  » “  *  » 

(il.l2)  ^(0(x,y)  -  f(x)  ♦  y*(r(^p(x))  (th«  •hwdlfiad  iM^rmn^tui  «xpr««»lon"). 

II.3-1*!*  A  R«forBulation  of  luhn-Tucker  Th»orta  1» 

This  slight  gsnerxlitstion  of  Th*orsa  1  in  il,  p.  484]  is  nssdsd  bsrs 
bscsuse  of  ths  BMning  of  insqiislitiss  givsn  in  (1.1.4).  |^Ths  posslbilitj 

^  T  1  11 

of  this  typo  of  gsnersditstion  is  indicstsd  in  i^l,  3«c.  8,  pp.  491-2 1. 

We  shxll  s*y  thAt  £  sstisfiss  ths  ConstrAint  .^uAlifioAtion  (C.Q.)  st 
X,  if  ths  rsquirsBQents  of  the  definition  in  1. 2. A  are  sAtisfisd  with  ths 
insquAlitiss  (4*0)  in  I. 2. A  intsrprstsd  in  the  sense  of  (1.1.4)*  0(x,j)  is 
given  by  (1)  in  I.l.  (It  is  IsmAteriAl  whether  g  or  *g  is  used.) 

Theorea. 

If  f  and  £  are  differentiable.  x^O^^  and  £  sAtisfies  C.>«.  At  x.  then 
there  exists  a  ytT  such  that 

y  -  0;  iJ^*y  •  0;  ^  *^11  7*0; 

X  -  0;  -  0;  -  0  for  all  x  -  0  . 

Note  that,  by  rirtus  of  the  definitions  in  II. 2. 2.  this  aeans  that 

if  -0  if  if  m  4^\ 

-  0  if  nj^.V  *.  The  other  inequalities  of  the  theorea  are  also  to 
be  interpreted  in  the  sense  of  (M.1.4).J 

11.  See  also  Hurwlci,  9,  pp.  VIII  -  2-6'. 


Th»orf  1. 
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12  '  1 
Definition.  An  M-dlMenslonel  vector  7  2*  *  *  *  *  ’^^  B  |  ^*  ^ 

ftCoeptAble  If,  for  eech  ■  t  (1)  bj  •  0*  And  (2)  ^  Is  An  even  integer 

if  h.(x)  <  -1. 


‘nieorflei. 


If,  for  soae  f  >0,  x  *■_  J)^ 

And  £  SAtisfies  C.^.  At  x,  then, 

-  V  13 

vector  7  •  jv  7  ;  such  thet 

(I.l*)  rj  -  0  for  All 

(l.l") 

(I.l»")  X  -  0; 

(I.2»)  rj^y.y-0  for  All 

(1.2*')  n  ^  .7  •  0; 

^  7 

(I.2»")  7-0. 


(x),  X  t  ^tg*  -  ^  ‘ll^f^rentleble, 

for  Any  AceeptAble  ,  there  exists  a 


X 


> 


0; 


•  0; 


(The  relAtlons  (I)  Are  necessAry  conditions  for  a  nonnegAtlve  (in  the 

senee  of  (II.I.4))  SAddle-polnt  of  '  0(x,y)  At  {x,j).) 

In  perticulAr,  the  reletlons  (I)  Are  sAtlsflod  If  one  selects  y  •  7(  ) 

U 

such  that 

(1.3*)  (!♦  '/a)y^( '/  )  ■  yni(O)  for  Ail  me  . 


12.  In  AAny  applied  problems,  hjj(x)  -  0  for  All  a  And  aH  x  ^  0.  It 
WAS  pointed  out  by  Dr.  Masao  PukuokA  thAt,  in  the  Absence  of  such  An  Aseuap- 
tion,  the  requlreaent  of  non-negatl vlty  of  the  components  of  Is  insuffi¬ 
cient  for  the  proof  of  the  theorem. 

13.  The  ber  over  0  denotes  evAlustion  At  x  -  x,  y  •  y(  >;). 

14.  7^(0)  -  y  in  luhn-Tucker  Theorem  1  (cf.  II. 3. 1.1). 
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If  the  selection  !■  nad*  in  accordanc*  vlth  (1.3* )»  tha  aqualltj 
(1.3")  A  ^ 

vill  hold.  (o0(^*7)  *  0;  thla  is  obrlousljr  ths  ssna  aa 

0(x,j)  in  (1)  of  I.l.) 


Proof. 

for  ^  ■  0,  ths  prscadin^  thaor«B  follows  diraetljr  froa  ths  rsfonu- 
lalsd  vsrsion  of  ths  Kiihn-Tucksr  Thsorsa  1  gisan  in  II. 3. 1.1.  Thus  thara 
exists  a  vactor 

(I*)  y(0)  -*1  y^(0),  yjlO),...,  yn(0)} 

with  the  required  properties. 

Consider  now  the  case  ^  0.  We  shall  show  that  y(  )  daflnad  by 
(1.3*),  i.a.,  explicitly,  by 

d")  7,(7)  '  7,(0), 

(where  y^(0)  is  that  of  (1*))  satisfies  the  relations  (1). 

We  first  observe  that  (1")  yields 

(2)  (1  ♦  V  '  "  y.(0)»  m  i 


(When  hjj(x)  •  1,  (2)  follows  directly  fro*  (1").  Whan  h^(x)  1,  we 

have  *  8*^^)  >  0,  hence,  by  (1.2),  y^(0)  •  0;  (!■)  than  yields 

y*(  ^,  )  •  0  (2)  follows.) 

line  e 


M 

2:  (1 

a-1 


^,)y,(  r)  h,(x) 


n  € 


(3) 


♦  >- 


(2)  ijiplles 
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M  _  3«-(x)  J/ 

iU)  ♦  I ^  7,(0)  nt^. 

noting  that  tho  right  m«ib«r  of  (4)  is  iontic^  with  concludo 

thftt  tha  rolotlona  (I.l)  hold  for  all  with  non-nogatlro  coapononta,  sinco 
tho7  ara  known  to  hold  for  -  0. 

(1.2*)  la  eataibllshod  by  the  fact  that  tha  right  aaabar  of 

la  non-nagatlra  for  atc^Y,*,  taro  Tqttl^c/^  whan  la  accaptabla  (aaa  tha 
dafinitlon  abova)  alnea,  for  any  «a  h,(x)  ^  1,  and,  furtharaora, 

•  0  if  a^c^*,  In  which  caaa  h,(x)  •  1. 

How  auppoaa  that,  for  aoaa  a^t  y^,  ^  ^y  ^  !•••»  ^^(*)  ^  ^5  then, 

by  (I)  for  n  •  0,  y_  (0)  -  0;  hanca  y_  { >7  )  -0,  and,  tharafora, 
c  ^  o  c 

*T,0  •  (  7  )  ■  ®- 

Sinca  (6)  claarly  holda  In  tha  altamatlya  caaa  -  0,  (1.2**) 

e  o 

foUowa. 

finally,  (1.2*")  holda  bacauaa  y_(  y  )  haa  tha  aaaa  algn  aa  y  (0)  and 

■  C  a 

tha  lattar,  by  (1.2*")  for  •  0,  la  non-nagatiya  If  at-Y*. 

1I.3>2>  Thaoraa  2. 

Let,  for  ao«o  s  >  0,  x<.S'?(x),  x€  0^^,  auch  that  (I)  is  eatlaflad. 

Thai 

(II)  >^0(x,y)  -  •^#(x,y)  for  all  j  •  0. 

For  we  hara 

0(x.7)  -  ^  t(x,y)  -  (y-y)  .rp-y.^p-0  fory-0 
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wh«re,  sine* 

_  V'  ^  * 

the  second  equelltj  follows  fro«  (1.2")  SAd  the  inequAlitj  fro«  (1.2*)' 


11.3.'.  Motstlon. 


(11.13) 


(2)  r  (21)  (n)\ 


-lx 


where 


0^(21)  o«^(2a)<°' 


end  either  coaponent  say  be  eapty. 


(N.U) 


I  II 


where 


(ll.li**) 


1  (1) 


X  -  ,  X 


11  (22) 

X  -  X 


\ 


(Hther  or  x^^  nsy  be  eapty.) 

It  should  be  noted  that,  by  (I)  end  (1.13), 


(i. !/*♦♦) 


o?  I  •  0 


II 


<  0  . 


11.3.^.  Definition  of  s  Regular  Constrained  MsudJidi. 

A.  In  Theresa  3  below  we  use  the  concept  of  a  regular  constrained  Bajdaxm. 
The  definition  of  such  a  n^'*i P"”  is  given  in  II. 3. 42.  To  state  it,  we  smst 


first  formulate  three  regularity  conditions!  \  1/  ,  \2 

/ 

V 

(B.0)  or  (C.iO),  (C.8),  (D.19)). 


3/  (eqs. 
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B.  Th«  First  R»gulArity  Con<Ution. 

Let  X  be  A  taIua  BAximizin^  the  function  f(x)  subject  to  *g(x)  ^  0, 
X  ^  0,  And  hence  Also  subject  to 


(B.l)  f(x)  -  0 

> 

X  -  0 

where  the  inequAllties  Are  to  be  Interpreted  in  the  sense  of  (N.I.4). 

Fro«  (11.6)  And  (li.7)  it  is  cIaat  thet,  for  sufficiently  sbaH 
TArlAtlons  of  X,  the  constrAlnts 

(B.2)  gl^'(i)Jo 

Jo. 

which  Are  a  pArt  of  (B.l),  cat  be  disregArded.  Hence,  At  x,  f(x) 
possesses  a  IocaI  BATiwie  subject  to 


(B.3) 


t,  (b)  •  0, 

x(2)  J  0. 


l] 


f2ll 


Let  g  be  A  subrector  of  g  -  suca  thAt  -  C'|g  ,g  '  (  And  write 


(B.l) 


;  t  tt 

|C  I  g 


]• 


The  co«ponents  of  unless  they  produce  An  inconsistency,^^  CAn 


be  disresArded  in  the  process  of  mexial zAtion.  (l.e.,  0.  _  ■  0 

.'1] 


If  the  LAgrenglAn  miltipiier  vector  y  (corresponding  to  the  constrAlnts 
g'-^^  (x)  ^  0)  is  pArtltioned  according  to 


(B.5) 


-.Ij  j-t-tti 

y  -  I  y  .7  r* 


it  is  AlwAys  possible  to  put 
-tt 


(B.6) 


-  0  , 


15.  Which  CAnnot  happen  since  x  exists. 


P-706 

7-20-55 

-19- 


and  thlf  vlll  b«  don*  in  what  follow*. 

A**ualn«  that  th*  constraint*  (B.3)  &r*  consistent,  w*  Mgr  r«plaes 
thsa  by 

(B.7)  g*'(x)  -  0 


Th*  first  regularity  condition  \  1  /  ia 


(B.8) 

say. 

Note  I. 


rark  (g^.(l))  -  dia  -  M*’  , 


corresponds  to  the  requirea^nt  of  non-dtfeneracy  in  linear 
prograssdjig  (see  Oantaig,  I  i*,  p.  34oj)> 

Not*  2.  \l  /  iaplies  C.^.  (see  Appendix  1). 


C.  Tkl.  Second  aegularity  Condition. 

Since,  by  (N,/*),  (11.6),  (N.U*),  (B.4), 

(C.l)  g^I)  -  0 


it  follows  that,  as  a  function  of  x  , 

f(x^,  •  f(x^,  0) 

has  at  a  local  aarj  nm  subject  to  th*  constraints 

(C.2)  "  «^(x\  0)  -  0 

x(^>^0. 

The  corresponding  Lagrangian  expression  becoeies 


(C.3)  ^(x^,  y^)  -  f(x^,  0)  ♦  y'’.g''(x^,  0)  . 
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Usin^  the  reforvulAtion  of  Kuhn-Tuoker  Theor«  1,  flY«n  in  we  ukj 

eseert  the  exletence  of  a  j  euch  that 

(C.4r^  •  0;  ^  -  0  ; 

r"  -  Oi  ■  °  • 

-t 

It  Blight  happen  that  some  components  of  y  ranish.  Write 

(C.6»)  7^  -It*,  7®} 

where 

(C.6")  every  component  of  is  different  from  lero 

and 

(C.6»")  •  0  , 

L«t  be  correspondingly  partitioned  as 

(C.6^'^)  -  {g*,  g°]  • 

Bow  suppose  that  ^  (x^,  y^)  hms  a  non-negative  aaddle-point^^  at 
/-I  -t  V 

(x  ,  j  ).  One  can  then  easily  verify  that 

(C.7)  •  f(x\  0)  ♦  r»  .  g«(x^,  0) 

has  a  non-negative  saddle-point  at  (x^,  y*). 

But  then  x^  maximizes  f(x^,  0)  subject  to  g^(x^,  0)  ^  0  and 

^  0.  Hence  in  this  case  the  components  of  g°  could  have  been 

disregarded  in  the  original  maximization  problem  (^f^g  "  ®  t  (2]1^’ 

lg**g  J 

However,  complications  might  arise  if  ,  y^)  did  not  have  a 

16.  By  theorem  3  In  Kuhn-Tucker,  a  sufficient  condition  for  this  is 
that  f  and  g  be  both  concave. 
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non-n«gatiY«  saddle-point  at  (x^,  j^).  To  taka  oars  of  this  cass»  on# 
talght  rsqulrs  that 

(C.8*)  ia  •■ptj  unlsaa  ^(r^,  j^)  has  a  local  non-nsfatlTs 

saddls-point  at  (x  ,  j  ). 

Howsrsr,  to  simplify  aattsrs  ws  shall  iapoas  ths  sssaingly^'^  strongsr 
condition 

(C.8J)  f®  is  sBipty. 

It  iollows  that 

(C.8p  M*  »  dim  -  dim  s 

Let  by  (C.8^))  dsnots  ths  sst  of  indicsa  of  g*.  Clsarly, 

for  mt  ^  ^ "“7  <  0* 

Now  suppose  ths  prscsding  rsasoning  had  bssn  carrisd  out  in  isms 
of  *g  instead  of  Nothing  would  be  changed,  except,  possibly,  ths 
signs  of  some  components  of  ths  Lagrangian  sultiplisr,  to  be  denoted  by 

’7« 

I.e.,  we  would  hare  *j^  >  0  for  me  -  ^  *  t.  ^  *7*  >  0  o**  *7^  <  ® 

Let/ 

(C.9*) 

if  and  only  if 

and 

•y  <  0  . 

Then,  it  is  clear  from  (1.2.2)  that  we  may  put 
(C.9")  J 

’  7^  •  -*7m  » 


for  mt  Y  *  ^  ^  ^ 


be  defined  by  the  relation 


17.  Cf.  11.3.6.0. 
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•o  th*t 

(C.9»")  y®  ^  ®  for  all  . 

H«nc«,  without  logs  of  gwrality  (as  coaparad  with  (C.8^))  (C.8^)  aajr 
b#  rastatad  as  the  sacond  regularity  condition. 

\^2/  (C.8«)  I  g°  is  eapty 

v' 

) 

'l  and 

Jjjj  >  0  for  all  Mt  •  . 

Tha  first  ragularity  condition  than  iaplias 

(C.10»)  rank 

where 

(C.IO")  M*  -  dim  g*  . 

D.  The  third  reitularity  condition. 

Dll.  When  the  first  two  regularity  conditions  are  satisfied,  second 
derlvatlTes  are  continuous,  and  is  non-empty,  it  is  possible  to  show 
(sse  Appendix  2)  that  a  certain  quadratic  fona  is  non-positive  when 
some  of  the  variables  are  restricted  in  sign.  The  third  regularity 
condition  (eq.  (19))  is  a  strengthening  of  (D.18)  requiring  that  the 
■1'  r  !  '  '*'r  in  ^  c  .'le’aMvf  ‘  r‘  r  ct'.v.'i.  '  'O:  - 

■  ’  ‘  •  n'll c •  ;  ;  <- 

■  -o'  '  ..  .  n'  ?  f-  ''y.  ■  ■  '■ 

D:2.  The  third  regularity  condition  is  formulated  in  teras  of  a 
function  q(t)  of  a  new  variable  vector 

(D.l)  t  -  J  t*,  t**  ^ 

which  is  obtained  by  a  trans format ion  of  coordinates  fro«  x^  after  the 
latter  has  been  partitioned  so  that 
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(D.2)  -(x*,  X**]  , 

where  x*  it  a  »ubv*ctor  of  x^^^. 

We  ihAll  (*)  define  r*  And  x**;  (b)  write  down  the  trAnefonMitlon 
defining  -jt*,  1**}”  ^  tenu  of  define  q(t);  (d)  fonrulAte 

the  third  regulArity  condition. 


In  the  reuAlnder  of  section  D  it  !•  Aseimed  thAt  holds;  In 

D:3  -  D:4  it  ie  aIbo  ABSuiced  thAt  x^  la  not  eapty. 

Di3.  Piret  cAte;  M*  -  0. 

Write 

(D.3)  t  -  t**  -  x^  -  x^, 

so  thAt,  by  (D.l)  And  (D.2),  x*  And  t*  Are  empty,  And  define  (D.4) 


q(t)  -  f(x^, 

•  f(t*«,  0). 

The  third  regulerity  oondition  for  thie  oabb  is  formilAted  in 
(D.19)  below. 

D:i*.  iecond  CA»e;  M*  >  0. 

(a)  The  definition  of  x*. 

From  \i^  (oq.  (C.IO*))  it  follows  thAt  there  exists  A  (non¬ 
empty)  M*-dimenslonAl  subvector  x*  of  x^^^euch  thAt 
(D.5)  8*  #  is  An  M*  by  M*  (M*  •  1)  non-singular  aatrix.  We  then 

X 

define  x**  by  (D.2)  and  by 


(D.6) 

CleArly 

(D.7) 


[ 

i 


x 


(21)1 


f  • 

; 
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(b)  The  Transformation  frog  to  t. 
Let 


(D.0) 

h*  -  1 

-  g* 

where  1 

is  the  M •-dimensional 

vector 

with  (scalar)  l»s 

t  -  ^t* 

,  t**]  is 

then 

defined 

by  the 

transformation 

(D.9) 

-1) 

t* 

-  h*(r*. 

X**,  X 

.11, 

-2) 

t»* 

-  x^^*  . 

We  also 

partition 

t** 

by 

(D.IO) 

t** 

V.  ' 

,(21) 

$  ^ 

where 


AU)  (12) 

t  •  X 


,(21).  /.-’I) 

This  is  obvioutljr  consi  * '''i*  A.*)  hri  ) 

( c )  The  definition  f  :  ^ ‘  . 

By  (D.0),  the  Jacobian  H  of  the  transformation  (D.9)  is 


h* 


h* 


T*  t 


(D.12) 


H 


0 


so  that,  by  (D.5), 
(D.13*)  I  H  I-  ■ 


«•  ,  1  ^  0. 
X 


1  •  e  • , 

(D.13")  H  is  non-sin|fular . 

T 

Hence,  locally,  (D.9)  can  be  solved  for  In  lems  of  t;  we  smiy 
write  this  solution  as 


(D.U) 

where 

(D.15) 


I 


■(t) 


ir*,  r**] 
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and 

(D.16)  X*  -  r*(l) 

X**  -  r»*(t)  -  t**. 

The  function  q(t)  la  now  defined  %s  f(i)  eraluated  at  -  x^^  and 
with  x^  expreased  in  terma  of  t,  l.e., 

(D.l^)  q(t)  -  f(r(t).  x"^^)  =  f(r*(t*,  t«).  t**,  0). 


D:5.  The  ftatemer.t  of  the  third  regularity  condition. 

We  f'lare  now  defined  q(t)  for  all  M*  provided  the  firet  regularity 

condition  (  ^  satisfied  and  x^  la  non-eopty.  It  la  shown  In 

10 

Appendix  2  that 

unleaa  x**  la  empty,  there  exists  >  0  such  that, 
for  all  t**€  S  r  (x^). 


(D..0) 


< 


(t**  -  x^)»  (t**  -  X**)  -  0 

(21)  > 


if  t 


0. 


The  third  re/cularlty  condition  Isa  strengthening  of  the  preceding 

Inequality.  It  states  that 

( 

(D.19*)  X**  Is  empty 


(D.19)  j  (0.19**)  there  exists  >  0  such  th^t,  for  all  t*^t5p(x^*). 

1  (tee  -  x*e)’  -  x**)  <  0 

,  if  t^^^^  ^  0  and  t»*  ^  X**, 

Mote.  The  situation  covered  by  (0.19*)  is  of  importance 
since  it  permits  the  treatment  of  a  large  class  of 

cases  where  f  and  £  are  linear. 


10.  Assuming  \  1  /  and  'y2  /  and  the  continuity  of  the  second  derlTatlves. 


E.  Dcf ini lion. 
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f(x)  it  sAld  to  hav*  4  regiilar  Bi4jcl*uffl  at  x  subject  to  g(x}  ^0,  x  •  0, 

If  the  three  regularity  condltiona  \l/  ,  \2  /  ,  \3^  ("qe.  vB.P)  and 

V  V  V 

hence  (C.IO);  eq.  (v'.B);  and  eq.  (D.19)),  respectively  are  satisfied  at 

X  and  X  0-  . 


II. 3*5.  Theorep  3* 

-  -  19 

If,  for  SOBS  r>0,  X  f  6^  (x),xa  regular  traximun:,  of  f(x) 

'  ) 

subject  to  g(x)  •  0  and  x  -  C,  f  and  £  are  differentiable  (with  regard  to 

x),  and  furthermore,  <vhen  x^  la  non-e*pty,  have  continuous  second  order 

I  20 

derivatlTes  *rlthi  regard  to  x  ,  then,  for  all  acceptable  sufficiently 

1  21 

large  ,,  , 


x^  is 


«pty» 


/  or 


1  I  -I 

(III.I*)  i  (III.l)  (x^  -  xM* 


*1 


I 


^  .  (21)  >  .  1,-1 

if  X  •  0,  X  ^  X  , 


and 


for  so«e  >  0,  and  all  x^  >  ^(x)  such  that 


(III.2») 


1 


'  >  7- 

X  -  0,  X  ^  X, 


(III. 2)  ^(x,7( '^  ))  <  v^0(x,y(y|)) 


19.  The  term  "regular  majclicuB"  is  defined  in  II. 3*4. E. 

20.  TTie  term  "acceptable"  is  defined  at  the  beginning  of  II. 3. 1.2. 

21.  "Efficiently  large  "  is  defined  to  mean  thiSt  eacf.  component 

mt.  of  is  sufficiently  large. 


P-706 

7-20-55 

-27- 


aj^d  y{  ) 

Holt. 


4r«  d«fln*d  &a  in  ThsorM  1. 

^  Theory  3  i*  v'Alld  for  f,£  lino^r  if  r**  is  empty 
(regardlesi  of  whether  x*  is  empty ),  provided  the 
first  two  regularity  condition*  hold.  'If  both 
X*  and  x-*^  are  empty,  x^  i*  empty,  uid  the  theorem 
follow!  from  I1.3.6.A{*).  If  x**  is  mepty  while 
X*  Is  non-empty,  uae  II.3*6.A(*)  and  (b)  together 
with  II .j. 6. B. 2. 1-3  (since  g*  1*  non-empty  and  t** 
is  empty).!.  Not*  that  x**  is  empty  at  the  basic 
solutions  of  a  linear  prograamdng  problem. 


11.3.6.  Proof  of  Theorem  3. 

II. 3. 6.0. 

In  II. 3. 6. A,  it  is  shown  that  impUe*  (III.2*). 

In  II.3.6.B,  it  is  shown  that  (IIl.l*)  is  true. 

It  can  be  seen  that  if  Theorem  3  i*  established  for  the  case  of 

f  empty,  then  Theorem  3  is  also  true  if  (l)  g^'^  is  not  empty,  and/ 

Of  (2)  g°  is  not  empty  but  y  y^)  has  a  non-negative  saddle- point  at 
-I  -r  - 

(x  ,  y^),  since  in  either  case  x  remains  unchanged  and  the  additional 
terms  in  the  modified  Lagranglan  expression  vanish  at  y  (cf.  eq*. (B.6) 
and  (C.6*")  in  II. 3. 4). 

Hence,  with  no  loss  of  generality,  we  may  henceforth  assume 
to  be  empty ,  1 . e. , 

(1)  g  ■  g*. 


22.  The  desirability  of  explicit  treatment,  of  the  linear  case 

was  emphasised  by  Dr.  Masao  Fmkmoka. 
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II. 3. 6. A.  (III.1»)  lapliea  (I1I.2*). 

In  tt\li  ••ctlon  we  show  (III. I*)  l*pLlei  (III. 2*),  l.e.,  that, 

In  a  sufficient!/  small  neighborhocKj ,  If  (III.l*)  le  aosuaed  to  be  ralld 
and  the  Inequalitiee  x  •  0,  x  ^  x,  hold,  (111.2)  follows.  We  write  0 
Instead  of  >,0  tlirou^hout.  (III.l*),  x  ^  0,  x  /  x,  are  also  assuaed 

I 

throughout  II. 3.6. A. 

Let 


By  (1.3")  And  (H.U**), 


i  -  I,  II. 


But  then  (III. 2)  follows  from  the  well  known  (*Frechet*)  property 

2"* 

of  differentials  which,  as  applied  to  the  present  case,  states  that, 

24 

given  any  cJ>  0,  there  exists  an  €  >  0  such  that, 

I 

(2)  —4 —  (0(x,j)  -  0(x,y)  -  ?  •  "  )  <  a 

1 

if 

(3)  1<  €  . 

Choose 

(4)  0  -  -  —Z’  I  0_« 

I  ^  ' 

which  is  positive  by  (l). 


r 

23.  3ee  Hille  j^lO,  p.  72,  ,  Definition  eq.  (iii). 

24.  If  a  is  a  real  nuaber,  |a  1  denotes  its  absolute  value.  If 

a  •  -<*1*  I  'rtth  the  a^^  real,  ,  k  i /p  denotes  the 

-  '  •  1  -  ' 

'k-1  “ 


•length*  of  a. 


Th«n,  for  a  aufflcientij  1 ,  we  hATe  (bj  (2)) 
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(5)  -  ^  ^  (0(x,7)  -  0(x,jr))  *  O  |<  (3 

which  implies 


(6) 


r 


(0(x,y)  -  0(x,7))  <  0 


axid  hence  (III. 2). 

If  is  ettpl7,  this  completes  the  proof  of  the  Theorem  3*  since 


X  ^  X  then  implies 


CfH  ,  ^  I 

F  ^  0.  If  X 


3 


is  not  eDpt7f  we  must  consider  the 


(b)  Second  case;  ^ 


II 


0. 


Since  it  is  assumed  that  x  x. 


S 


II 


•  0  implies 


(7) 


i  0. 


In  Tirtue  of  the  exietence  of  the  second  derlratives  of  0  with 
regard  to  x^  (b7  definition  of  0,  and  the  assumptions  concerning  the 
second  derivatlres  of  f  and  £  with  regard  to  x^ )  we  hare,  b7  Tajlor^s 
Theorem, 

(8)  0(x,7)  -  0(x,7)  "  ^  1  *  *  2 

where  0  •.  t  denotes  0  j  t  eraluated  atx*x,  x-x^O  ^,0<0<1. 

x'^x'^  j  ^  j  _ 

It  now  suffices  to  note  that  (^  )  0  ^  is  negatire  at  x  (since 


j 


xV  ^ 

(III.l*)  is  assumed  to  hold  and  its  h/potheses  are  satisfied)  and  con¬ 
tinuous  in  the  neighborhood  of  x  (b7  the  hTpotheses  of  the  theorem 
concerning  the  second  derlratives  of  f  and  g),  so  that,  for  a  sufflcientlj 
'"H  (  0  <  0.  Since  0  *  ^  ^  -  0  by  (N.U**),  (III.Z) 


small 


follows . 


II.  ^6.0. 
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(III. 1)  hold»  if  It  non-«aptj. 

B.l.  Klrst  C4aw:  g*  tapty. 

'  l' 

By  eq.  (1)  In  II. 3*6.0,  g  is  *.ito  eapt) .  Htnct,  by  (1)  in  Theorem  1, 

(!•)  7(  -  y^^^o)  -  0. 

and ,  utln«  (N.12). 

(1")  ^^0(x,y(  ,^  ) )  -  fix). 

Since  g*  eopty,  we  have  M*  -  0,  and,  therefore,  the  definition  (D.4)  of 
^  appliee,  to  that  ( since  r*  it  empty  but  it  not)  t**  it  not  empty  and 

(2)  ^  ^  T  T  * 

(1")  and  (2),  together  with  the  third  regularity  condition  3/  (eq. 

V 

(D.I9)),  yield  (III.l)  for  a  sufficiently  a&all  neighborhood  of  x. 


B.2.  Second  cate;  g*  non-empty. 
Write 


B.2.1. 

(0)  t  (t,y)  -  0(r(t),  x^\  y) 

where  r(t)  is  defined  in  (D.li*).  (Where  it  is  desired  to  indicate  the 
dependence  of  ^  on  ,  we  may  write  f  instead  of  /"  . ) 

Then,  by  (D.I3)  (l.e.,  1  '  ),  we  have 


(2) 


r 


It 


^ttl  t-t  ’  r  1  ^  ^  •  1  ^•(*)» 


(  Vx' 

0  by  (1.3")  and  (N.U**). 


sl^all  now  show  that  (III.l)  it  impiie'd  by 


r  h  0  if  T 


i21) 


•  0  and 


4  0 


(3) 
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where  the  p4rtitionlng  of  TT  correepond*  to  thAt  of  t.  (S#ction»  B.2.2  - 
B.2.6  are  then  deroted  to  showing  thAt  (3)  holds.) 

To  see  thAt  (3)  Lsiplies  (Ill.l),  let  SAtisfj  the  IneqTiAllties 
^  0,  ^  .  Choose 


t  - 

'  t*  ,  _  T 

r  h* 

1 

h* 

X*  -  X*  , 

(u) 

-  c  ■  H(x  - 

•  ■  1 

X** 

1 

t**J 

L  0 

I  j 

x^*  -  X**J 

Since,  by  (D.13),  H  is 

non-singulAr , 

x}  implies  TT  ^  0.  Also, 

{u)  jlelds 


-(21) 

X 

of  X^^^  bj  (N,13),  And  -  0  bj  (1.6) 

hjrpotheses  of  (III.l)  laplj  those  of  (3), 
of  (III.l),  together  with  the  TAlldlty  of 

the  assertion  In  (3),  yield 

(8)  C  T<  0 


(3*)  r**  -  x*«  -  X** 

hence,  Ip  psrtlculAr, 


(5") 

But 

(6) 


(21)  (21) 

•  X 


-(21) 

X  -  0, 


(21) 

since  X  is  a  component 
Hence 

(,)  -(Jl)  .  ,(21) 

And  thus  x^^^^  ^  0  implies 
HAving  shown  thAt  the 
we  see  thAt  the  hypotheses 


But,  using  in  su'*ce88lor  (^),  (2),  And  simplifying,  we  hATe 


(8)  4nd  (9)  yl*ld  the  concluelon  of  (III.l).  Thus  it  hAS  been 
••tAblished  thet  (’’)  implies  (III.l).  It  rea*vlns  to  be  ehown  that  (3) 
ie  valid.  (This  is  done  in  sections  B.2.2  -  B.2.6.) 

B.2.2. 

It  is  convenient  to  write  f' partitioned  fonn 


(1) 

Y 

Y  tn* 

• 

A 

I 

1 

1 

B  ! 

Y 

'  t*n* 

V 

T 

LB- 

c. 

where  t**  (but  not  t*)  naj  be  esipty.  (The  case  of  t*  eoptj  was  treated 
in  B.l.) 

B.2.3. 

It  will  now  be  shown  that  A  (i.e.,  i  ,  cf.  eq.  (l)  in  B.2.2), 

t*t* 

which  depends  on  >■)  ,  can  be  aade  negative  definite  bj  a  suitable  choice 
of  V/  . 

Recalling  that  Y*  denotes  the  set  of  indices  of  the  coaponents  of 
g*,  and  using  (11.9)  and  (D.9-1),  we  see  that,  for  me 

(1)  p,(x)  -  1  - 

(  a 


where  t^  is  a  coroponent  of  t*. 
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31nc*,  by  TTieoren  1  4nd  ©q.  (1)  in  11.3*6.0, 

(2)  y^(  for  ad 

wc  hav«,  from  th«  doflnltlona  of  and  ^0  (»q».  (1)  in  B.2.1,  (D.17), 

and  (N.12),  respoctively ) ,  and  the  preceding  relations  (l)  and  (2),  the 
equality 

(^)  Y  (t,y(/|  ))  -  q(t)  ♦  I  “)  • 

m  *:  /-f  * 

Writing 

(^)  f  "  q  » 

tn* 

we  have,  froB  (3)  and  the  definition  of  A  in  B.2.2, 

(5)  A  -  P-D 


where  D  -  lid  ^  ,  is  a  diagonal  matrix  (l.e., 

(6* )  d  ,  ■  0  for  m  ^  m* ) 

IB  .  m  * 


with 


where  the  second  equality  follows  from  (1.3*). 

Let  X  denote  the  largest  characteristic  root  of  P.  Since,  by  the 
second  regularity  condition  (  \2  /  ),  y  (0)  >  0  if  mti/i*  ,  we  siay 
choose  ^  ,  for  each  ml  *,  to  be  a  positive  even  integer  satisfying 


so  that 


>  .  o 


min  d  >  X  for  all  acceptable  0  •  h 
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>  o 

Then,  for  any  t*  /  0,  and  each  acceptable  ^ 

(8»)  t*»  F  t*  ^t*»  t*  =  '  r  <  r.  cl  t^ 

m  €  ®  L  * 

*  t**  D  t»  , 

1  •  0  •  ^ 

(8")  t*  ^  0  implies  t**(P-D)  t*  <  0  for  all  sufficiently  large 

acceptable  y  , 
or 

(8*")  A  is  negative  definite  for  all  sufficiently  large  acceptable  '/  . 

(8*")  suffices  to  establish  B.2.1,  eq.  (3),  and,  therefore,  (Ill.l), 
if  t **  is  arpty . 


&-2.4.  Now  assume  t**  not  empty.  !<<rite 


I  I  -A 

(1)  P  -  ! 

1  0  I  ^ 

and 

(2)  _ .  -  p’  y  P. 

3  '  tt 

V. 

Then  methods  used  in  B.2.1  to  show  that  3.2.1  pq.  (3)  Implies  (lll.l) 
can  be  used  to  show  t^^at 


(3  )  w’  ^  ^  w  <:  0 

implies  B.2.1  eq.  (3). 


for  w  ^  0, 
For  P  ^  •  i 

0 


(21) 

w  ^  0 


A-^B 


,  and. 


like  its  analogue  H 


in  B.2.1,  performs  an  identity  transformation  on  t**,  so  tlat  the  condition 
^  0  if  transformed  into  the  condition  w^^^^  -  O.J  It  reaaalns  to 
establish  (3).  Now  from  (2),  (l),  and  B.2.2.  eq.  (l),  we  hare 
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<  A  0 

.1-1  .1  . 

I  0  C-B*A  B 


80  t.^at 


w*  ^  Z  w  •  w*»  Aw»  ♦  »rMi  (C-P»A"^B)  w**  . 

Now,  by  P.2.3  ©q.  (S*")!  wa  tiaj  take  A  as  negative  definite,  and 

hence,  bo  eatablleh  (3),  it  will  suffice  to  show  that 


iU)  ,  =  (G-B*A‘1)  ^  <  0  if  w**  ^  0,  -  0. 

This  la  done  in  B.2.6  after  an  auxiliary  result  is  obtained  In  B.2.5* 

25  -1 

B.2.5.  It  will  now  be  shown  that  the  nor*  of  A  can  be  Bale  arbitrarily 
saiall  by  choosing  sufficiently  large. 

D  ^  Is  a  diagonal  taatrix  whose  non-tero  elesents  approach  xero  for 
large;  hence  N(D'’^)  can  be  inade  arbitrarily  small  for  large.  Then 
i(D  1)  •  N(D”1  N(P)  approaches  0.  For  sufficiently  large,  N(D  V)  <  1; 
It  follows  that^^ 

lince 

A  -  F  -  D  -  D(D‘^F-I)  , 


25>  It  does  not  matter  which  of  the  many  nonu  is  used;  cf.  Bowker  W. 
Note  that,  denoting  by  N(l)  the  nor*  of  the  matrix  I,  we  have  li(A^B)  ^  i(A) 
*  N(B),  N(AB)  ^  N(A)  N(B);  if  all  the  eleaents  of  a  matrix  approach  0,  so 
does  Its  norm.  If  I  denotes  the  Identity  matrix,  Il(l)  •  1. 

1 

26.  Waugh  7  ,  p.  lABj .  Let  6  be  a  square  matrix  such  that  I-B  is  non- 
singular.  In  view  of  the  Identity 

(I-B)-I  -  I  ♦  (I-b)~^B 
the  properties  of  the  nop*  yield  ^ 

N[(l-B)-i]  -  1  ♦  N  [(I-B)-^]II(B) 
which,  for  N(B)  <  1,  yields 
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It  follows  thAt 


And  7«rice 


-1 


N(A'^)  N(D'^)  N  |(D  "P-I)'  ,  , 

^  ^  1-N(D‘-^F) 


which  car,  be  iiAde  ArbItrArliy  amAll  for  large. 

B.2.b.  Cofieider  now  the  quAdrAtlc  fonii  ,  In  D.2.h  e^.  (4).  By  b.2.2 
and  B.2.3  Aq.  (3)» 


. 


t** 


Hence 


The  third  regularitj  condition  (  ^  3/^  ,  {D.19"))  inpliee 
(1)  w***  Z  w**  <  0  if  w**  ^  0,  >  0. 


As  shown  in  B.2.?, 


N(B*A”^B)  <  N(B*)  «(A"^)  N(E)  -  M(A"^)  j  N(B)! 
can  be  made  arbitrarily  aamall  by  choosing  a  large  enough  r|  .  Now 
(2)  I  w♦*»E♦A■^Bw^H^  I  -  n(b»A"^B)  w***w*«  , 

since  the  characteristic  roots  of  a  matrix  are  bounded  in  absolute  value 


by  its  norm. 

Also,  denoting  by  tt.e  maxlnrun  of  w-»*»dw^*A  subject  to  w*a*w** 

(21)  > 

w  •  0» 


•  1, 


< 


wo  have 

(3)  wAHf’CwA*  -  yV  »•■•*«** 

y 

and  ,  by  ( 1 ) , 
iU)  /y  <  0. 

n/ith  the  aid  of  (2), 


(5) 


ll(P*A'^B)j  wAA*w**  if  w**  4  0,  w^^^  ^  0. 


By  choosing  sufficiently  large,  so  that 

(6)  N(B*A‘^B)  0, 


we  establish  B.2./*  eq.  (4)  which,  in  turn,  yields  B.2.4  eq.  (3),  D.2.1 
®q*  (3)t  (in.l),  and  hence  Theorem  3* 
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III.  '.4**-Th*or«tlcAl  A:id  Econotalc  lnt«rpr#t*tlon  of  th*  Modified  U^ran^ian 
Approach . 

111.1.  Keasor.a  for  Uslrjt  tha  Modiflad  La^ranitian  Approach 

The  obvloue  Incentive  for  using  the  BOdlfled  La^angian  approach 
(l.e.,  using  ^0  with  a  sultablj  large  Instead  of  0  •  arises  In 

cases  where  the  convexity  hTpotheses  of  Theoreo  3  1-  [^ij  are  not  satisfied. 
However,  even  when  does  have  a  saddle-point,  it  nay  be  preferable  to  use 
the  modified  LAgrangian  approach  (  '^  with  some  positive  componeints).  Such 
is  the  case  when  certain  gradient  procedures  for  reaching  the  saddle-point 
are  to  be  used  (cf.  [^3])  and  it  is  essential  that  the  matrix  ,« ?  .  -  bs 
negative  definite.  The  latter  condition  would  not,  for  instance,  be  satis¬ 
fied  by  the  unaodlfied  lAgrar.gian  expression  (o#)  in  the  Linear  case  (l.e., 
where  both  f(x)  and  g(x)  are  linear  In  x)*  although  the  convexity  conditions 
of  Theorem  3  in  [ij  are  satisfied  and  a  saddle-point  does  exist. 

111. 2.  lame  Interpretation 

eflienever  0  possesses  a  saddle-point,  a  game  analogous  to  g^  in  1.3 
may  he  set  up,  with  ,^0  replacing  0.  TTd s  game  may  be  denoted  by  g(^0). 

hearing  in  mind  the  local  nature  of  tl.e  theorems  in  11,  g(  ^0)  still  has 

.  -  ^ 
the  important  property  x  -  x. 


Similarly,  an  analogue  of  g*  may  be  constructed  by  using  the  appropriate 

terms  of  ^0  instead  of  those  of  0.  The  economic  interpretation  of  such  a 

game,  as  well  as  the  analogue  of  gj^  (in  1.6)  will  te  considered  in  III. 3. 

0A 


27.  Th.e  gradient  methods  of  the  type  described  in  [_3j  result  in  constant 
amplitude  oscillations  (rather  than  convergence)  when  applied  to  the  unsiodl- 
fled  Lagranglar.  expression  for  the  linear  case.  Cf.  Samuelson,  [bJ  ,  pp.  i'’- 
22.  The  desire  to  remedy  this  swtivated  the  present  work  to  4  considerable 
extent . 
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III, 3  Kconoaic  Intorpr^tAtion;  D«c»ntrali ration 

3onild«r  first  tha  An4iogue  of  th«  allocation  gaae  (cf.  1.5)  in 
tha  modified  Lagrangian  approach.  If  the  axpresilons  derived  from  ^0  are 
substituted  for  those  derived  fro®  0,  the  nature  of  t^  e  game  is  altered  in 
only  one  essential  respect:  the  terms  or.  which  the  custodian  sells  prisiary 

cownoditles  to  the  manager.  It  is  easily  seen  that  the  selling  price  (per 

,  ^ 

unit)  of  the  m-th  primary  conrodity  is  now  given  by  yj|'^,j(’')j 

The  dependence  of  the  price  on  the  amount  purchased  is  a  familiar 
phenomenon  in  the  econortics  of  ”iiBperfect"  competition.  TT.ere  it  typically 
arises  under  conditions  of  ”increaslnit  returns'*  corresfon.ding  to  those 
wfiere  the  convexity  conditions  of  Theoram  3  in  [  l]  fail  to  hold;  it  also 
arises  under  conditions  of  "constant  returns"  corresponding  to  the  linear 
homogeneous  case  (cf.  eq.(l^)  in  1.6)  where  a  saddle-point  exists  but 
^  is  net  negative-def inite.  These  facts  suggested  iaitlallj  the 
possibility  of  the  modified  Lagranglan  approacfi. 

There  are  a  number  of  analogues  of  et^uations  1.6  (14-15).  One 


pie  is  the  following: 


r 


-  z  Gp  kp(x^)  -  r 


n  *  l^eee^N^ 


■ote  that  Pjjj  depends  on,  among  other  things,  ,  so  triat  the  niii  manager 
ivust  take  into  account  the  impact  of  his  decisions  or.  the  price  of  the 
primary  corsmodlty  in  tr.li  decentralised  economy. 
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Th«  d«centr^ir*tlor  of  the  sjstea  consist*  in  th*  fact  that  a 
custodlaxi  need  only  know  his  own  (*5^  component)  of  h  and  th#  net  demand 
for  that  coaneodlty  (which  helps  determine  p®)*  whil#  the  manager  need 
know  oniy  the  functions  kp  (p  -  l,...,p),  h^(m  -  1,...,  M),  and  th*  net 

r  IB 


demand  for  ^li  s  product 
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Appendix  1 


28 


that , 

(1) 


L^t  th«  first  r*/^ul*rlty  condition  (  Consider  x  fiich 

29 


gL^J(x).0  , 

X  >  0 


sxid  X  such  that 

(x-x 

(2)  * 

(2)  -(2) 


gl-^Mx-x)  >  0  , 


-  X  >  0  . 

M  — 

Dsflr.e  now  the  functior.  g  of  x  by 

(  •)  g^(>^)  -  |g^(x), 

where  x**  Is  defined  In  II.3«4.D. 

jissuming  to  be  oupty  (cf.  II.3.4.C),  like  x,  has  N  dlme^islons.J 
It  follows  that 

t 


g 


*  . 


*r*  *x** 

0  I 

0  c 


0 

I 


(4) 

and  hence 

(5)  g^  “  ^x*  ^  ^  ' 

Consider  now  the  relation  which  associates  with  a  real  number q  the 
values  X  of  X  for  which  the  equation 


(6) 


g 


'^(x)  -  g  (x)  ♦  - 


ag"  (x-x) 


28.  This  appendix  parallels  Leona  '’6.1,  in  RIlss  [_11J. 

29.  In  thd.t  appendix  all  inequalities  are  to  be  interpreted  in  the 

sense  of  (N.1.4). 
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Is  satisfied,  li.  >rlrtue  of  the  implicit  fur.ctton  theora*,  for  suf f Iclantljr 
small  values  of  a  (6)  defines  x  as  a  ( sir^gle-valued )  differentiable  function 
of  Q,  saj 

(7)  X  -  (a)  , 

such  th.at 

(fi)  ^  ^0)  -  X. 

[>if f erentlatlng  (6)  with  respect  to  a  and  setting  a  •  0,  we  have 
(9)  gj  V  iO)  -  g^  (x-x) 

and  hence,  because  of  (5), 


(10) 

f  |(0)  -  x-x. 

We 

shall  now  show  that 

(11) 

V"^(a)^lg  for 

a  >  0,  a 

sufficiently  iBall. 

py  (6), 

(1).  (2) 

(12) 

g^(x)  -  0  (x-x) 

>  0  for 

a  >  0  . 

X 

It  follows  that 

(13) 

(x)  >  0  for 

a  >  0. 

which  together  with 

(U) 

>0 

for  a  suf f 

'iclently  small, 

yields 

(U) 

1  [ti  (a)J  >  ^ 

for  a  > 

0  sufficiently  small 

P-'’06 

'’-20-35 

Now,  since  x*  Is  &  subvector  of  Is  &  subvector  of  jx*^, 

hence  (2)  end  (6)  Implj 

(16)  (a)  -  x^^^  ♦  a  -  x^^^)  ^  0  for  a  ^  0 

which,  together  with 

(1'^)  x^^^  •  (a)  ^  0  for  a  suf fic lent I7  shulII 

yields 

(18)  (a)  >  0  for  a  >  0,  a  sufficiently  smell. 

In  turn,  (15)  *nd  (18)  yield  (11). 

Now  let  us  Interpret  '*  q  sufficiently  small"  as  0  <  a  <  X  where 
X  >  0  and  define  the  function  by 

(19)  4^0)  -  (X  0)  for  all  0  s  ©  <  1* 

Then 

"f  (0)  •  I 

(20)  "fVo)  -  X  4"*(0)  -  X  (x-T)  (X  >  0) 

f  (0)  4  Cg  for  0  <  C  ^  1 

Since  (20)  are  precisely  t^,e  requirements  of  C.^., 
implies  l.g. 


it  has  been  shown  that 


Apptndlx  2. 
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We  shAll  now  show  thst.,  if  the  first  two  re^^ulArity  conditions  hold 
sjnd  is  *  neighborhood  of  x,  f  snd  £  s.re  assimed  to  possess  continuous 
derivatives  of  second  order  with  reg^d  to  x^  ,  (D.10)  is  T^id. 

Let  be  non-empty.  Then,  writing 

-1)  t*  -  h*(x)  -  1  (a  vector  l*i), 

(1) 

-2)  t*«  -  X<H*  , 

we  h.ave,  using  Taylor’s  theorem, 

(2)  q(t*,  t^)  -  q(t*,  t**)  -  •  (t*^»  -  t**) 


♦#  -  !♦*) 


(tM  -  t**) 


where  ’  ’  over  a  symbol  denotes  the  evaluation  at  t  •  t,  while  over 

a  symbol  denotes  evaluation  att«t,  t»t*0  (t**  -  t**),  0  <  0  <  1. 

Now  suppose  it  has  been  shown  that  (a)  q(t*,  t**),  has,  as  a  function  of 

(21) 

t”,  subject  to  the  constraint  t  >  0,  a  local  naximus  at  t**  -  t**, 
and  (b)  •  0*  Prom  (a)  it  follows  that,  in  a  sufficiently  small 

neighborhood,  the  left  member  of  (2)  is  non-positive  if  t^^^^  >  0.  But 
then,  using  (b),  we  see  thiat  the  quadratic  form  in  the  right  member  of 

(2)  is  non-positive.  olnce,  by  hypothesis,  is  %  continuous 

function  of  t*^,  we  have,  for  >  0,  and  in  a  sufficiently  small 

neigh  horhood  oft, 

(3)  (t»*  -  t**)  (t»*  -  t**)  <  0 


which  is  the  desired  result  (D.18).  Hence  it  remains  to  prove  (a)  and 
(b). 
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( а )  ( t.  • ,  •  ^ -  a  ^  2  furtCtl  on  _r  ’  ,  aub.loc  t  ^  -i  »  il  loc^I 

■axiaua  at  t*^  -  t**. 

It  follows  from  the  remarks  at  the  begimirvg  of  that  f(x^,0), 

as  a  function  of  ,  nas  a  local  aiaxisruB  at  ,  subject  to  the 

cor.stralnta 

g^(x^ ,  0)  -  u 

^  ^  ^  (  2''  ) 

X  ^  ‘  j  0  . 

Hence,  the  subject  to  the  same  constraints,  q(t)  has  a  local  najclmxm 
at  t.  Now  we  sust  distinguish  the  two  ways  iii  which  the  ’’milder”  (C.8*) 
second  regularity  condition  (  ^  satisfied. 

(1)  ^0^  (x^,  7^)  has  a  non-negatlTe  saddle-poir.t  at  (x^,  y  ).  I.e., 

locally,  since  y°  -  0  by  (C.6*”), 

(5)  r(x^,0)  ♦  y*  •  g*(x^,0)  ^  f(x‘,0)  ♦  y*  •  g*(x^,0)) 

for  all  x^  such  that  j  0. 

But  g*(x^,  0)  -  0  1  ecause  of  (4),  and  g*(x^,0)  in  tne  left  maaber 
of  (5)  vanishes  for  t*  •  t*.  Hence  (f)  yields,  locally  a.nd  for  >  0, 

(б)  f(r*(t*,  t**),  t«-*,0)  <  f(r*(t»,  !♦♦),  0) 

which  means  precisely  that  q(t*,  t**)  has  a  local  maximum  at  t**  subject 
only  to  t  ^ 

(2)  g°  Is  empty. 

In  this  case  iu)  is  equivalor.t  to 

-1)  0)  -  0 

(211 

-2)  >  0. 

But  C^-i)  is  necessarily  satisfied  If  t*  -  t*  and  hence  can  be 
disregarded,  ilnce  q(t)  was  seen  to  :ave  a  local  maximum  at  t  subject 
to  (1*),  it  follows  that  q(t*,  t*^)  will  have  a  local  maximum  at  t** 
subject  only  to  >  0. 
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(t) 


(8) 


W«  ^Lave 


-  0. 


♦  f 


We  now  evaluate  the  three  expressions  on  the  right-hand  side  of  (8). 
We  start  with  r*  .  Noting  that 

(9)  g*i  [r*(t*,  t**),  t**],  o}  -  0  for  all  t**, 

we  obtain  by  differentiation  with  respect  to  t**,  ufln^  (D.9-1)  and(D.16), 
and  evaluating  at  t  -  t| 

(10)  g*  r*  ♦  g*  -  0 


in  virtue  of  (C.IO)  (\l/)  this  can  be  solved  yielding 


(11) 


-  -(i*  )'^  g*  . 

t*^  X*  r** 


To  flr.d  f  f  ,  we  write  the  condition  that  0  . 

in  the  form 


0  (eq.  (C.4-1)) 


(12)  'J 


♦  g*  y*  ■  0 

i*  *1*  ^ 


■  0. 


(The  terns  ii.volvlng  g°  vanish,  of  course.) 

Substituting  (12)  and  (11 )  into  (8),  we  hare 


(13) 


(-3^  •  *  (-?*  •  (-(i*.)  ^  1 

X*  t  X*  X**  j 


■  (-?•  •  «^)  •  (?*  • 


-  0  . 


Thli  completes  tne  proof  of  (D.lft). 
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